Grammar Gets Hard With Time Travel